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ABSTRACT 


The  range  estimation  problem  is  generally  solved  by 
assuming  a  low  order  target  mass  center  motion  description  (such 
as  constant  velocity  or  constant  acceleration)  or  by  postulating 
a  well  defined  manuever.  Assumptions  are  often  made  that 
require  the  receiver  signal  associated  with  a  well  tracked 
target  to  have  a  narrow  bandwidth.  These  assumptions  are 
unreasonable  for  certain  range  estimation  problems.  An  approach 
general  enough  for  use  with  virtually  any  pulsed  narrowband 
transmitter  waveform  and  a  variety  of  finite  parameter 
descriptions  of  time  varying  target  range  and  cross  section  is 
developed.  The  associated  best  approximation  problem  is 
nonlinear  but  has  a  special  structure  which  permits  a  computable 
solution  in  applications  of  interest  involving  thousands  of 
unknowns.  An  Appendix  provides  an  example  of  estimating  a 
polynomial  propagation  delay  from  observations  of  the  radar 
receiver  signal. 
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INTRODUCTION 


One  way  to  extend  the  capabilities  of  a  radar  to  targets  at 
greater  range  or  targets  of  lower  cross  section  (keeping  other 
factors  constant)  is  to  base  parameter  estimates  on  a  larger 
number  of  receiver  signal  samples  collected  over  a  longer 
observation  time.  Popular  observation  models  might  not 
adequately  describe  the  observed  process  over  the  longer 
observation  times.  For  example,  when  the  signal-to-noise  ratio 
is  small,  from  several  seconds  to  a  few  minutes  of  data  might  be 
required  in  order  to  perform  meaningful  parameter  estimation. 

In  this  problem  many  targets  do  not  appear  to  have  the  simple 
constant  velocity  or  constant  acceleration  mass  center  motion 
proposed  in  the  literature  (Refs.  [2],  [i<],  [10],  [11]).  In 
addition,  even  small  target  aspect  angle  change  results  in 
complex  dynamics  of  the  observed  cross  section  over  the 
observation  time  (Ref.  [2]).  Accurate  models  for  the  observed 
receiver  signal  over  increased  time  intervals  are 
correspondingly  complex. 

This  complexity  severely  limits  the  usefulness  of  an 
ordinary  "matched  filter"  receiver.  The  observation  model 
should  be  known  exactly  except  for  an  unknown  amplitude  scalar 
and  unknown  constant  time  delay  to  design  the  optimal  matched 
filter.  The  model  proposed  here  is  considerably  more  complex. 
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One  possible  approach  to  estimating  the  parameters  of  these 
complex  time  dependent  models  is  to  exploit  the  model's 
smoothness.  When  a  sufficient  number  of  observations  can  be 
accumulated  in  a  short  enough  time,  linearizations  of  the 
analytic  models  for  the  processes  involved  adequately  describe 
the  observations.  Then  a  certain  notion  of  optimal  estimation 
is  realized  by  the  "Kalman  filter"  (Refs.  [1]  p.  36,  [6]  p. 

107). 

Unfortunately,  as  the  observation  time  is  increased  such 
linearizations  of  smooth  models  must  eventually  become 
inadequate  (Refs.  [5],  [I'll).  If  the  nonlinearities  are 
structured,  then  these  popular  estimators  are  generalized  by 
various  schemes  and  are  said  to  be  "extended"  or  "adaptive" 
(e.g.,  Refs.  [1]  p.  195,  [^],  C15]).  But  in  these  extended  and 
adaptive  forms  much  of  the  original  optimality  of  the  estimator 
is  obscured  (Ref.  [19],  p.  25). 

Any  of  the  optimal  estimators  can  be  arranged  as  nodes  in  a 
"tree"  or  "bank"  of  estimators  by  discretely  parameterizing  the 
hypotheses  under  which  a  particular  node  of  the  tree  is  shown  to 
be  optimal  (Refs.  [10],  [15],  [17]).  These  schemes  can  be 
implemented  in  a  way  that  preserves  the  original  notion  of 
optimality.  Typically  though,  a  problem  arises  in  choosing  the 
parameter  values  which  define  the  nodes  of  the  tree.  If  too 
many  nodes  are  defined  the  computation  time  becomes  excessive. 


If  the  wrong  nodes  are  defined  then  good  approximations  of  the 
optimal  estimates  are  not  obtained. 

The  notion  of  minimum  norm  (or  best)  approximation  is  of 
great  Importance  in  establishing  the  optimality  of  estimators. 
Instead  of  contributing  to  the  proliferation  of  extended  and 
adaptive  techniques,  this  report  examines  the  problem  of  best 
approximation  of  the  time-varying  receiver  signal  from  the 
viewpoint  of  modern  computational  methods.  The  resulting 
estimator,  when  Interpreted  in  the  least  squares  sense,  is  also 
the  maximum  likelihood  estimator  for  a  Gaussian  estimation 
problem . 

In  this  report  best  approximation  techniques  are  adapted  to 
solve  a  general  radar  surveillance  problem.  Let  r  be  a  vector 
in  a  normed  vector  space  H  containing  the  subset  S.  A  best 
approximation  of  r  on  S  is  defined  as  a  vector  r  in  S  such  that 
II  r  -  r  II  <  II  r  -  y  ||  for  all  y  in  S.  The  set  S  consists  of 
functions  which  are  called  ideal  receiver  signals  in  this 
report.  The  vector  r  in  the  definition  is  the  function  whose 
values  are  observed  over  time  in  the  radar  receiver,  called  the 
observed  receiver  signal  in  this  report. 

The  ideal  receiver  signals  are  constructed  from  prior 
knowledge  of  the  noiseless  radar  observation  process  and 
are  parameterized  by  functions  which  characterize  the  attributes 
of  the  target.  Because  of  modeling  errors,  hardware  factors, 
thermal  and  other  noise,  an  observed  receiver  signal  is 


generally  not  contained  in  S.  Thus  the  best  approximation 
problem  in  this  context  becomes  the  problem  of  choosing  the 
functions  (characterizing  the  attributes  of  the  target)  which 
minimize  the  norm  of  the  error  between  the  observed  receiver 
signal  and  an  ideal  receiver  signal. 

Many  schemes  involving  significantly  more  assumptions  than 
those  made  in  this  report  fit  within  the  general  framework  which 
is  to  be  described.  The  purpose  of  this  report  is  to  describe 
an  estimator  which  can  be  implemented  to  provide  a  very  general 
narrowband  radar  surveillance  capability  without  precluding  the 
use  of  other  constraints  to  handle  special  cases. 

First,  nonlinear  functions  are  proposed  for  the  ideal 
receiver  signals.  Their  form  is  general  enough  to  approximate 
observations  of  signals  having  time-varying  range  and  cross 
section  over  extended  time  intervals.  The  formulation  is  kept 
general  so  that  any  of  various  popular  narrowband  transmitter 
waveforms  could  be  utilized.  The  resulting  ideal  receiver 
signals  involve  time-varying  delay  and  amplitude  functions. 

The  principal  problem  is  to  constructively  characterize  the 
best  approximation  of  an  observed  receiver  signal  on  the  set  S 
of  ideal  receiver  signals.  A  typical  parameterization  of  S  can 
involve  thousands  of  variables.  Although  the  best  approximation 
problem  is  nonlinear,  its  special  structure  exposes  a  linear 
subproblem  which  can  be  solved  very  efficiently  on  modern 
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floating  point  processors.  The  solution  of  the  linear 
subproblem  Is  used  to  define  two  other  nonlinear  problems  which 
have  the  same  solution  as  the  principal  best  approximation 
problem.  After  parameterization,  the  two  nonlinear  problems  are 
of  significantly  lower  dimension  than  the  original  problem  and 
their  solution  can  be  approximated  numerically  in  a  number  of 
ways . 

Finally,  an  Appendix  provides  some  details  concerning  the 


•  solution  of  the  ordinary  least  squares  approximation  problem. 

In  the  example  it  appears  that  commercial  hardware  is  adequate 
for  real  time  implementation  of  an  estimator  based  on  the 
techniques  developed  in  this  report  as  part  of  a  target  tracking 
system  for  a  very  general  class  of  targets. 
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2.  CHARACTERIZATION  OF  THE  SET  OF  IDEAL  RECEIVER  SIGNALS 

In  this  section  the  ideal  receiver  signals  are 
characterized  as  complex  valued  functions  of  time.  These 
functions  define  the  set  from  which  a  best  approximation  of  the 
observed  receiver  signal  is  chosen.  By  definition,  all  prior 
knowledge  concerning  the  radar  observation  process  should  be 
utilized.  Then  it  is  natural,  using  other  assumptions,  to 
propose  a  signal  characterization  which  is  different  from  the 
one  presented  here.  The  purpose  of  this  section  is  therefore 
restricted  to  present  Just  one  characterization  which  motivates 
the  definition  of  the  approximating  functions  used  in  the 
discussion  of  the  best  approximation  problem  in  Section  3. 

So  that  the  discussion  does  not  become  academic,  the 
proposed  characterization  is  designed  to  be  practical  for  mcst 
narrowband  radar  surveillance  missions.  Because  the  radar 
receiver  signal  is  naturally  observed  in  the  time  domain,  the 
signals  are  characterized  as  time  domain  functions.  The  ideal 
signals  are  also  characterized  as  deterministic,  although  a 
stochastic  approach  is  possible. 

Throughout  this  section,  the  signals  encountered  in  the 
radar  and  the  effects  of  channel/target  modulation  are  generally 
represented  by  complex  valued  functions  of  continuous  time.  The 
usual  definitions  of  pointwise  addition  and  multiplication  of 
such  functions  apply.  The  development  of  this  section  closely 
follows  Fig.  2-1,  which  associates  a  signal  amplitude  at  time  t 
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with  each  of  several  major  steps  in  the  radar  observation 
process . 


As  usual,  each  signal  is  associated  with  some  real 
disturbance,  such  as  the  electric  field  at  a  point  in  space  or  a 


voltage  in  the  transmitter/receiver.  The  signal 
characterization  is  derived  by  supposing  that  the  transmitted 
signal  x:t  -*•  x(t)  is  transformed  by  the  channel/target  into  the 
modulated  signal  m:t  -*■  m(t).  In  the  receiver  at  each  time  t, 
m(t)  is  multiplied  by  a  locally  generated  signal  value  v(t). 

The  resulting  signal  s:t  s(t)  has  a  bandwidth  small  enough  to 
permit  sampling  of  the  cont i nuous- t ime  functions  at  low  sampling 
rates  for  subsequent  digital  processing. 

2.1  Narrowband  Channel/Target  Modulation 

First  the  modulated  signal  m:t  -*•  m(t)  is  constructed.  In 
order  to  simplify  the  derivation  of  the  m-rdvlated  signal  a 
simple  linear  channel  assumption  is  used.  It  is  assumed  without 
loss  of  generality  that,  except  for  a  time  delay  proportional  to 
the  propagation  path  length,  the  medium  effects  are  negligible. 
Attenuation,  polarization,  refraction  or  other  medium  effects 
can  be  modeled  if  desired.  The  additional  parameters  might  be 
estimated  jointly  with  other  parameters  or  their  values  might  be 
available  as  prior  knowledge. 

The  value  of  the  modulated  signal  at  a  given  time  t  is 


obtained  from  a  linear  transformation  involving  a  complex  valued 
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range  image  function  at(e(t),  r)  +  a(e(t),  r).  The  function 
a;(e(t),  r)  +  a(0(t),  r)  depends  on  the  relative  real  range  r 
and  on  the  value  at  a  time  t  of  the  real  vector-valued  function 


0;t  -*■  0(t)  which  determines  the  aspect  of  the  target  relative  to 
the  radar  1 i ne-of -s i ght .  Figure  2-2  illustrates  the  geometry  of 
the  problem.  Define 

m(t)  =  /  a(0(t  -  T(t)/2  -  r/c),  r)x(t  -  T(t)  -  2r/c)dr  (2.1-1) 

^t-T ( t)  /2-r/c 

where 

=  {r|a(0(t) ,  r)  ^  o} .  (2.1-2) 

The  function  T:t  ■»  T(t)  is  a  real  valued  function  of  time.  The 
value  T(t)  is  usually  interpreted  as  the  round  trip  propagation 
time  of  an  imaginary  particle  traveling  at  real  velocity  c  and 
reaching  (at  time  t)  the  end  of  its  propagation  path.  The 
propagation  path  extends  from  a  point  in  the  transmitter  (where 
x(t)  is  defined)  to  a  point  on  the  target  which  corresponds  to 
one  half  the  path  length  and  back  to  a  point  in  the  receiver 
(where  m(t)  is  defined).  This  is  an  idealized  nonr elat  i  v  ist  i  c 
argument.  The  set  R^  will  be  called  the  range  extent  of  the 
target  at  time  t.  After  (2.1-1)  is  accepted  as  an  adequate 
representation,  the  remaining  development  follows  readily. 

Suppose  that  x:t  -*•  x(t)  is  Fourier  transformable, 
specifically  that  X ;  oi  X(<u)  exists  with 


x(  t) 


/  X(  0))  e''“'“du 
B 


(2.1 -3) 


where 

B  =  la)|  X(a))  #  0}  .  (  2 . 1  -  ) 

The  set  B  will  be  called  the  transmitter  bandwidth.  In  practice 
there  will  be  a  bounded  set  B  which  is  sufficient  to  adequately 
approximate  x(t)  by  (2.1-3). 

Using  (2.1-3),  equation  (2.1-1)  becomes 

m(t)  =  /  a(e(t  -  T(t)/2  -  r/c),  r) 

'^t-T  ( t)/2-r/c 

.  /  X(<u)eJ“^’^-^(*^^-2^/°>du,dr.  (2.1-5) 

B 

Formally  interchanging  the  order  of  integration  yields 

m(t)  -  f  X(a))e-^“^'^‘''^'^^  ^ 

B 

•  /  a(0(t  -  T(t)/2  -  r/c),  r)e  ^  ^  ^  drdu 

^t-T(t)/2-r/c 

»  /  X(u))e'^“^*^"‘^^’^^  ^A(0(t)  ,  u))da).  (2.1-6) 

B 

Here  the  definition 

A(0(t),  w)  =  ;  a(0(t  -  T(t)/2  -  r/c),  r )  e"'^  ^“''^°dr  (2.1-7) 

'^t-T(t)/2-r/c 


is  made  to  write  (2.1-6)  in  compact  form.  For  each  time  t, 
equation  (2.1-7)  defines  an  unnormalized  Fourier  transformation 
of  a  range  domain  function. 

Suppose  that  a(t)  approximates  A(e(t),  at)  on  the  set  B. 

That  is  there  exists  art  -►  o(t)  such  that 

a(t)  =  A(0(t)  ,  (o)  (2.1-8) 

for  ui  in  B  and  each  time  t.  For  each  time  t,  A(e(t),  id)  is 
approximately  constant  on  B.  The  assumption  (2.1-8)  is 
usually  called  a  narrowband  assumption,  probably  because  it  is  a 
useful  approximation  whenever  the  transmitter  bandwidth  B  and 
the  target  range  extent  ane  appropriately  small. 

Using  (2.1-8),  equation  (2.1-’6)  becomes 

m(t)  =  a(t)/  X((D)e'^“^^"‘'^^^  ^d<D 

B 

-a(t)x(t-T(t)).  (2.1-9) 

This  defines  the  final  form  of  the  modulated  signal  m;t  m(t). 
The  result  indicates  that  the  modulated  signal  is  approximately 
a  delayed  and  amplitude  scaled  version  of  the  transmitted 
signal.  The  simple  form  for  m(t)  is  a  direct  result  of  the 
narrowband  assumption  and  the  linear  channel  assumption, 
although  other  arguments  may  be  used  to  obtain  the  result 


i 

} 


i 

! 

Two  special  cases  are  of  interest  where  the  expression  for 
m(t)  can  be  given  exactly  in  closed  form.  If  collapses  to 
{0}  (a  point  target)  at  each  time  t  then  A(e(t),  ui)  does  not 
depend  on  u.  Then  a:t  ■»  a(t)  exists  such  that  (2.1-8),  and 
hence  (2.1-9),  become  exact  regardless  of  the  transmitter 
bandwidth.  Also  when  B  collapses  to  ItOo}  (continuous  wave 
transmission)  then 

m(t)  oc  A(e(t),  oio  ^  (2.1-10) 

regardless  of  the  target  range  extent. 

2.2  The  Ideal  Receiver  Signal 

Having  constructed  the  modulated  signal  m:t  m(t),  the 
ideal  receiver  signal  s:t  s(t)  is  defined  by 

s(t)  =  m(t)v(t)  =  a(t)x(t  -  t(t))v(t).  (2.2-1) 

The  ideal  receiver  might  have  an  estimate  x  of  t  and  set 

v(t)  -  x»(t  -  T(t)),  (2.2-2) 

the  conjugate  of  x(t  -  T(t)),  to  keep  the  bandwidth  of  (2.2-1) 
small.  Then 

s(t)  =  a(t)x(t  -  T(t))x*(t  -  T(t)).  (2.2-3) 

It  is  customary  in  radar  technology  to  suppose  that  the 
transmitted  signal  consists  of  2N  +  1  "pulses"  each  of  time 
duration  T.  Then  the  transmitted  signal  x:t  -*■  x(t)  can  be 


represented  by 


x(t)  -  2.  p  (t)z(t  -  nA). 

n--N 


(2.2-i4) 


Here  A  is  a  real  constant,  the  function  z:t  +  z(t)  characterizes 
the  signal  for  a  single  pulse  and 


p„(t) 


1  ,  -T/2  +  nA  <  t  <  T/2  +  nA 
0,  otherwise. 


(2.2-5: 


It  is  assumed  that  T  <<  A  so  that,  for  example,  the  sets 
|t|pn(t)  *  o}  for  -N  <  n  <  N  are  disjoint.  That  is,  the 
pulses  do  not  overlap. 

Equation  (2.2-3)  becomes 


s(t)  •  a(t)(  I  p  (t  -  T(t))z(t  -  nA  -  T(t))) 
n--M 


(  1  "  T(t))z*(t  -  mA  -  T(t))). 

m--N 


(2.2-6) 


If  T(t)  =  T(t),  then  the  assumption  T  <<  A  also  implies  that 
Pn  ( t  -  T(t))pn,(t  -  T(t))  -  0  when  n  ^  m.  With  this  result, 
equation  (2.2-6)  will  simplify  to 


s(t)  -  o(t)  I  q(t)z(t  -  nA  -  T(t)) 
n--N 


z*(t  -  nA  -  T(t)) 


(2.2-7) 


where 


QnCt)  -  p^(t  -  •r(t))p^(t  -  7(t)).  (2.2-8) 

As  a  practical  matter,  the  simple  form  (2.2-7)  will  always  be 
valid. 

The  expression  (2.2-7)  is  representative  of  the  ideal 
narrowband  receiver  signal.  It  provides  a  concrete  example  for 
further  comments  in  the  Appendix  related  to  implementation  of 
estimators  for  solving  the  problems  which  are  dicussed  in 
Section  3.  It  also  serves  to  motivate  the  structure  imposed  on 
the  set  S  of  approximating  functions  for  the  discussion  of  the 
best  approximation  problem.  Using  expression  (2.2-7),  define 
the  functions  s:(o,  t)  s(o,  t)  and  s(a,  T):t  s(a,  T)(t)  by 


s(a,  T)(t)  -  a(t)  I  q  (t)z(t  -  nA  -  T(t)) 

n--M 

•  z» (t  -  nA  -  T(t) )  (2.2-9) 

Then  for  each  scalar  ’a’  and  function  a;t  o(t)  and 
6:  t  -►  6(t)  , 


N 

s(aa  +  B,  T)(t)  -  (ao(t)  ♦  B(t))  I 

n--N 

•  z(t  -  nA  -  T(t))z»(t  -  nA  -  T(t)) 

N 

-  aa(t)  I  q  (t)z(t  -  nA  -  T(t)) 

n--N 

N 

•  z*(t  -  nA  -  TCt))  ♦  B(t) 

n--N 

•  z(t  -  nA  -  T(t))z»(t  -  nA  -  T(t)) 

-  as(o,  T)(t)  +  a(B,  T)(t).  (2.2-10) 

That  is,  the  function  s:(a,  t)  s(a,  x)  is  linear  in  the  first 
variable.  This  linearity  property  is  typical  of  models  for  the 
ideal  receiver  signal  and  is  a  key  property  abstracted  to  the 
approximating  functions  of  Section  3» 

Consistent  with  the  stated  objectives,  the  expression 
(2.2-7)  iP  a  reasonable  model  for  the  ideal  receiver  signal 
associated  with  a  large  class  of  targets  and  radars.  The  most 
restrictive  assumption  utilized  in  its  derivation  is  probably 
the  narrowband  assumption  (2.1-8).  In  practice  this  restriction 
constrains  the  bandwidth  occupied  by  the  transmitted  signal 
x:t  x(t).  Otherwise  any  form  for  x:t  x(t)  can  be  used, 
Including  all  of  the  popular  phase  coded  waveforms  utilizing 
Barker  codes  (Ref.  [20],  p.  316)  or  linear  frequency 


modulation  (Ref.  [20],  pp.  290,  292).  Equation  (2.2-17)  is 
general  enough  to  model  virtually  all  targets,  including  simple 
point  targets  (Ref.  [20],  chapter  10)  and,  at  the  other  extreme 
rotating  objects  whose  dimensions  are  significant  compared  to 
the  wavelength  of  the  transmitted  waveform.  In  the  Appendix  an 
example  of  particular  parametric  forms  for  a;t  -►  a(t), 

T:t  -►  T(t)  and  z:t  -»  z(t)  is  given.  For  now  sufficient 
structure  has  been  Imposed  to  discuss  the  best  approximation 


problem. 


3 


BEST  APPROXIMATION  OF  AN  OBSERVED  RECEIVER  SIGNAL 


The  previous  section  characterizes  the  ideal  receiver 
signals  defining  the  set  from  which  a  best  approximation  of  the 
observed  receiver  signal  is  chosen.  In  this  section  the  best 
approximation  problem  is  defined  and  discussed.  First  a  few 
definitions  are  made  to  establish  the  underlying  structure  for 
the  problem.  The  definitions  are  motivated  by  the  properties  of 
the  characterization  of  the  ideal  receiver  signals  developed  in 
the  previous  section  but  remain  general  enough  to  ensure 
compatibility  with  many  other  characterizations  which  might  be 
proposed . 

Let  H  be  a  Hilbert  space  of  complex  valued  functions  of  the 
real  (time)  line  with  the  usual  pointwise  operations  of  addition 
and  scalar  multiplication.  In  the  space  H  the  norm  is  denoted 
by  11*11  and  the  inner  product  is  denoted  by  <•,•>.  Let  A  be  a 
subspace  of  H  and  let  T  be  some  subset  of  H.  Suppose  that  there 
exists  a  function  s:A  x  T  -►  H  which  abstracts  the  relevant 
properties  of  the  model  developed  in  Section  2.  Specifically 
s:(o,  t)  ■»  s(a,  t)  satisfies  the  following  linearity 

Property;  s(aa  +  6,  t)  -  as(a,  t)  +  s(B,  t)  for  all  complex 

scalars  a,  a  and  6  in  A  and  t  in  T.  (3.0-1) 

This  property  imposes  the  required  structure  for  the  discussion 
of  the  best  approximation  of  an  element  of  H  on  the  set 


19 


S  -  (s(o,  T)|ot  in  A,  T  in  t}.  (3.0-2) 

A  subset  of  S  also  plays  an  important  role.  The  set 

is  defined  for  each  t  in  T  by 

-  (s(o,  t) |a  in  a}.  (3.0-3) 

The  property  (3.0-1)  implies  that  for  each  x  in  T,  is 
a  subspace  of  H.  Note  also  that 

S  -  US.  (3.0-11) 

xeT 

The  element  of  H  which  is  to  be  approximated  is  called  the 
observed  receiver  signal,  while  the  approximating  set  S  consists 
of  elements  called  ideal  receiver  signals. 

The  best  approximation  of  the  observed  receiver  signal  r 

A 

in  H  on  the  set  S  is  the  ideal  receiver  signal  r  in  S  such  that 
II  r  -  r  II  £  II  r  -  y||  for  all  y  in  S.  It  is  customary  to  consider 
the  questions  (i)  when  does  the  best  approximation  exist,  (ii) 
when  is  it  unique,  and  (iii)  how  is  it  characterized.  The  first 
two  issues  are  briefly  addressed  before  considering  the  third, 
which  is  the  subject  of  primary  concern  to  this  report.  In 
particular  a  constructive  characterization  is  desired,  which  is 


also  readily  computable  in  special  cases  of  interest. 


3.1  Existence  and  Uniqueness  of  the  Best  Approximation 

The  theory  of  best  approximation  is  well  developed  when  the 
approximating  set  is  a  subspace  of  H.  Although  many  special 
cases  of  nonlinear  approximating  sets  have  been  considered,  it 
appears  that  a  unified  theory  is  lacking  (Ref.  [18],  p.  359). 

The  most  popular  nonlinear  set  in  approximation  theory  is 
probably  the  convex  set.  It  is  well  known  that  when  the 
approximating  set  is  a  closed  convex  subset  of  H,  then  the 
existence  and  uniqueness  of  the  best  approximation  is 
guaranteed  . 

Furthermore,  for  many  parametric  best  approximation 
problems  the  existence  of  a  unique  best  approximation  is 
effectively  equivalent  to  convexity  of  the  approximating  set. 
This  happens  when  the  approximating  set  is  naturally  compact. 

To  see  this  consider  the  result  attributed  to  Efimov  and  Steckin 
in  Ref.  [18],  p.  368.  This  result  asserts  (in  a  more  general 
form)  that  if  for  every  element  r  in  H  there  exists  a  unique 
best  approximation  of  r  on  a  compact  set  S,  then  s  is  convex. 

It  is  generally  not  too  restrictive  in  parametric  estimation 
theory  to  suppose  that  S  is  the  continuous  image  of  a  compact 
parameter  set.  Then  the  compactness  of  S  is  guaranteed  and  the 
result  of  Efimov  and  Steckin  applies.  In  this  case,  given  the 
compactness  of  S,  the  existence  of  a  unique  best  approximation 
to  an  arbitrary  element  r  in  H  is  equivalent  to  the  convexity  of 


The  particular  choices  of  functions  s:(o,  t)  s(a,  t) 
which  arise  in  the  Appendix  are  constrained  by  existing  radar 
hardware  and  physical  models.  As  a  result,  the  approximating 
set  S  of  functions  of  the  form  (2.2-7)  is  not  convex,  although 
it  is  easily  made  compact.  Thus,  the  uniqueness  of  the  best 
approximation  cannot  be  guaranteed  for  arbitrary  r  in  H.  The 
observation  r  in  H  must  be  structured  somehow  if  the  best 
approximation  problem  is  to  have  a  unique  solution. 

A  common  method  is  to  assume  that  each  r  is  ultimately  of 
the  form 

r-s+n  (3.1-1) 

for  some  s  in  S  and  some  n  in  S"^.  The  set  S"^  is  defined  by 

=  {x  in  H|<x,  s>  -  0  for  all  s  in  s}.  (3.1-2) 

Thus  the  observed  receiver  signal  consists  of  an  ideal  receiver 
signal  plus  an  orthogonal  error  (or  noise)  function.  Now  let  y 
be  any  element  of  S.  It  follows  from  the  Pythagorean  property 
that 

Up  _  y  II 2  ,  II  p  _  j,  +  j,  _  y  11  2  ,  jj  ,j2  +  11  3  _  y  II 2  _  (3.1-3) 

Because  (3.1-2)  implies  that  ||  r  -  y 'j  >  j|  n  1|  whenever  y  «  s  it  may 

be  concluded  that  condition  (3.1-1)  implies  that  s  is  the  unique 
best  approximation  of  r  on  S. 


There  are  various  devices  for  imposing  the  condition 
(3.1-1).  These  often  involve  spaces  of  stochastic  processes  or 
random  variables.  In  addition,  other  geometries  can  be  used  to 
resolve  the  existence  and  uniqueness  issues.  The  specific 
devices  used  in  a  particular  problem  are,  to  some  extent,  a 
matter  of  personal  preference.  The  detailed  structure  of  an 
estimator  based  on  the  characterizations  of  the  best 
approximation  which  follow  will  ultimately  determine  how  the 
existence  and  uniqueness  issues  must  be  resolved. 

3.2  Construction  of  the  Best  Approximation 
Four  problems  are  defined  in  this  section.  Each  one  is 
either  a  best  approximation  problem  or  is  closely  related  to  a 
best  approximation  problem.  It  is  assumed  that  each  problem  has 
at  least  one  solution. 

The  best  approximation  problem  of  interest  is  defined  by 

the 

Principal  Problem:  Given  r  in  H,  find  a  best  approximation  of  r 

A  A 

on  S,  that  is,  find  a  in  A  and  t  in  T  such  that 
II  r  -  s  (  a  ,  T  )  II  <  |l  r  -  s  (  a  ,  t  ) '! 

for  all  a  in  A  and  x  in  T.  (3.2-1) 

A  A 

The  function  s(a,  x)  will  be  called  a  solution  of  the  principal 


problem  (3.2-1). 


By  a  well  known  projection  theorem  (Ref.  [13].  page  51)  the 
error  r  -  s(a,  t)  Is  orthogonal  to  the  subspace  S^.  In 
part i cular 

A  A  A  A 

<r  -  s(a,  t),  s(a,  t ) >  =  0.  (3.2-2) 

The  function  s:(a,  t)  s(a,  t)  of  two  variables  is 
nonlinear  (in  the  second  variable).  Otherwise  many  efficient 
methods  would  be  available  to  solve  the  principal  problem.  The 
first  step  in  solving  such  a  nonlinear  problem  might  be  to 
reduce  the  problem  to  a  finite  dimensional  one.  A  reduction  in 
the  dimensionality  can  be  accomplished  by  introducing  a  finite 
dimensional  parameterization  of  the  sets  A  and  T.  A  finite 
dimensional  parameterization  of  the  set  A  is  a  function 
f:P;^  A  from  the  finite  dimensional  set  onto  the  set 
A.  Just  as  f:PA  -♦-*  A  denotes  a  finite  dimensional 
parameterization  of  the  set  A,  let  gtPj  T  finitely 
parameterize  the  set  T. 

Then  the  most  obvious  numerical  solution  of  the  general 
nonlinear  best  approximation  problem  is  to  attempt  numerical 
minimization  of  ||  r  -  s(a,  t)  ||  on  P;^  x  P-p.  Alternately, 
necessary  conditions  associated  with  the  optimal  solution  of  the 
general  problem  can  be  formulated,  yielding  a  new  problem.  If 
the  original  problem  has  a  solution,  it  is  contained  in  the  set 
of  solutions  to  the  new  problem.  In  special  cases,  this  new 
problem  obtained  from  necessary  conditions  might  have  a  closed 
form  solution,  or  it  might  otherwise  be  easier  to  solve  than  the 
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Figure  3-1.  The  point,  set  and  functional  relationships 
associated  with  the  best  approximation  problem  are 
illustrated.  Cross-hatched  sets  are  subspaces  of  H. 


original  problem.  But  when  reformulation  of  the  original  best 
approximation  problem  leads  to  another  nonlinear  problem, 
numerical  optimization  is  usually  more  effectively  applied  to 
the  original  problem  (Ref.  [13].  P»  271).  In  any  case, 
numerical  success  is  elusive  when  large  numbers  of  variables  are 
involved . 

Instead  of  solving  the  principal  problem  as  if  it  were  a 
general  nonlinear  problem,  it  is  advantageous  to  exploit  the 
linearity  property  (3.0-1)  to  effectively  reduce  the  dimension 
of  the  numerical  solution  of  such  problems  (Refs.  [7],  [9], 
[16]).  In  this  case  the  principal  problem  contains  a 

Linear  Subproblen:  Given  r  in  H  and  x  in  T,  find  a  best 
approximation  of  r  on  ,  that  is  find  in  A  such  that 

II  r  -  s  (  ,  T  )  II  <  II  r  -  s  (  a  ,  x  )  || 

for  all  a  in  A.  (3.2-3) 

A 

The  function  s(a^,  x)  will  be  called  the  solution  of  the 
linear  subproblem  (3.2-3).  In  this  case,  a  projection  theorem 


guarantees  that 


<r 


T  )  ,  S  (  O 


t)>  -  0. 


(3.2-i|) 


-  s ( . 


The  approximating  set  is  a  subspace  of  H.  Best 
approximation  on  a  subspace  is  a  standard  linear  problem,  and 
the  linear  subproblem  can  be  solved  efficiently  by  a  number  of 
techniques  which  are  not  suitable  for  the  general  nonlinear 
problem.  The  number  of  unknowns  in  the  parameterization  of  A 
(the  dimension  of  P^)  which  can  be  practically  accomodated  is 
also  larger  than  for  a  general  nonlinear  problem.  The  Appendix 
contains  additional  remarks  concerning  a  closed  form  solution  of 
the  linear  subproblem  for  a  particular  example. 

In  order  to  use  the  solution  sCo^,  t)  of  the  linear 
subproblem  to  construct  a  solution  of  the  principal  problem, 
define  the 


A 

Alternate  Problem:  Given  r  in  H,  find  t  in  T  such  that 
II  r  -  s(a;^,  t)||  <  II  r  -  s(o^,  t  )  II 

for  all  T  in  T.  (3.2-5) 

Thus  s(a:J',  x)  denotes  the  solution  of  the  alternate  problem 


(3.2-5) 


A  simple  Inequality  chain 


j  r  -  s(oi~,  T)|i<||r  -  s(a^,  T)lj  <  ||r  -  s(o,  t)1I  (3.2-6) 

which  holds  for  each  a  in  A  and  t  In  T  implies  that  the  solution 
of  the  alternate  problem  also  solves  the  principal  problem. 

Thus  it  is  possible  to  construct  a  solution  to  the  principal 
problem  by  numerical  optimization  over  T,  utilizing  the  solution 
of  the  linear  subproblem.  This  is  extremely  important  in 
practical  applications,  as  illustrated  by  the  example  in  the 
Appendix,  when  long  observation  times  are  required.  In  that 
example  the  increase  in  observation  time  leads  directly  to  an 
increase  in  the  dimensionality  of  both  the  nonlinear  principal 
problem  and  the  linear  subproblem,  but  does  not  directly 
increase  the  numerical  dimensionality  of  the  nonlinear  alternate 
problem . 

The  alternate  problem  is  not  the  only  nonlinear  optimization 
problem  over  T  which  also  solves  the  principal  problem.  Suppose 
T  in  T  satisfies 

II  s(a-,  or  >  ||s(a^,  t)  P  (3.2-7) 

for  all  T  in  T.  The  orthogonality  condition  (3.2-i()  permits  the 
application  of  the  Pythagorean  property  to  both  sides  of 


which  follows  from  (3«2-7).  Then 

||r  -  s(a“,  t)I|*  <  (|r  -  s(a^,  t)||*  (3.2-9) 

for  all  T  in  T. 

Therefore  a  solution  of  the  alternate  problem  (and  hence  the 
principal  problem)  can  also  be  found  by  solving  the 

Final  Problem:  Given  r  in  H,  find  t  in  T  such  that 

II  s(o^,  t)  II  >  l|s(o,,  t)ll  (3.2-10) 

for  all  T  in  T. 

Thus  it  is  possible  to  solve  the  principal  problem  by  each 
of  the  following  methods. 

1.  Solve  the  alternate  problem  (3.2-5)  by  optimization 
over  T  utilizing  the  solution  of  the  subproblem 
(3.2-3). 

2.  Solve  the  final  problem  (3.2-10)  by  optimization  over 
T  utilizing  the  solution  of  the  subproblem  (3.2-3). 

3.  Solve  the  principal  problem  (3.2-1)  by  optimization 
over  T  X  A. 


Because  of  the  linearity,  there  are  many  Interesting  cases  where 
a  closed  form  solution  of  the  linear  subproblem  Is  easily 
computed.  One  case  Is  discussed  In  the  Appendix.  Then  by  using 
methods  1  or  2  numerical  optimization  over  the  set  P/^  of 
parameters  characterizing  A  may  be  avoided.  Thus  computation 
based  on  methods  1  or  2  may  be  considerably  faster  than 
computation  based  on  method  3. 

It  is  possible  to  restrict  the  assumptions  used  in  this 
report  In  such  a  way  that  iisCa^,  x )  jl  becomes  the  ordinary 
"ambiguity  function"  of  radar  technology  (Ref.  [20]).  Thus, 
|is(a^,  T )  i|  may  be  regarded  as  a  generalized  ambiguity 
function,  and  the  final  problem  is  analogous  to  numerical 
maximization  of  the  ambiguity  function.  This  suggests  that  when 
properly  implemented,  estimators  based  on  the  final  problem 
will  perform  at  least  as  well  as  the  canonical  radar  receivers 
associated  with  the  usual  ambiguity  functions.  The  estimator 
will  produce  the  same  estimate  as  many  of  these  receivers  in 
appropriate  special  cases,  but  will  accomodate  significantly 
more  general  target  assumptions  when  necessary. 


ll 


SUHMARY 


An  appoach  to  solving  the  range  estimation  problem  for  a 
very  general  class  of  targets  has  been  presented.  The  technique 
can  be  applied  to  virtually  any  pulsed  narrowband  system.  The 
penalty  for  such  generality  Is  that  the  approach  requires  the 
solution  of  a  nonlinear  best  approximation  problem. 

Furthermore,  the  Appendix  presents  a  least  squares  application 
where  typically  hundreds  or  thousands  of  parameters  are  to  be 
estimated,  making  a  direct  numerical  solution  impractical. 

A  partitioning  of  the  variables  exposes  two  additional 
nonlinear  problems  with  solutions  which  also  solve  the  original 
best  approximation  problem.  Each  new  problem  contains  a  linear 
best  approximation  subproblem  which  can  be  solved  in  closed  form 
and  efficiently  implemented  on  modern  floating  point 
processors.  This  effectively  reduces  the  dimension  of  the 
nonlinear  problem  to  the  point  where,  as  in  an  example  in  the 
Appendix,  a  numerical  solution  is  possible. 

The  Appendix  presents  some  additional  details  concerning 
the  least  sq  ares  solution  of  the  problem.  Particular 
parameterl zatlons  of  the  transmitter,  propagation  delay  and 
amplitude  functions  yield  an  example  which  is  particularly 
suited  to  the  problem  of  observing  targets  at  low 
s i gnal-to-noise  ratios.  In  this  case  the  long  observation  time 
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APPENDIX 


In  this  appendix  the  signal  characterization  of  Section  2 
is  specialized  to  particular  forms  typical  of  a  narrowband 
radar.  The  best  approximation  concepts  of  Section  3  are  applied 
to  the  least  squares  approximation  of  the  observed  multi-pulse 
receiver  signal  associated  with  the  target. 

First  particular  forms  for  the  sets  A  and  T  and  the 
functions  x:t  -►  x(t)  and  v;t  ■*  v(t)  are  chosen.  Then  a  solution 
of  the  linear  subproblem  (3.2-3)  is  proposed.  As  in  Section  2, 
an  informal  approach  is  used  in  the  Appendix,  but  for 
concreteness  H  can  be  taken  to  be  L*([-1,1]).  It  is  easy  to 
formally  adapt  the  results  to  a  finite  dimensional  space  by 
sampling  continuous  time  functions.  In  E*^  a  numerical 
solution  is  possible.  A  simple  estimate  of  the  floating  point 
computation  rate  required  for  the  proposed  solution  suggests 
that  commercial  hardware  is  adequate  to  implement  an  estimation 
scheme  based  on  the  techniques  described  in  this  report  as  part 
of  a  real-time  tracking  system. 

The  set  A  is  defined  by  assuming  that  the  value  of 
a;t  ■*  a(t)  in  (2.1-9)  is  approximately  constant  over  a  time 
interval  corresponding  to  a  transmitter  pulse  width.  Thus  A  can 
be  defined  by 


33 


(A-1  ) 


A 


A 


lost 


N 

>  o(t)|a(t)  -  I  A^q^(t),  A^  in  c} 


where  C  is  the  field  of  complex  numbers  and  Qnst  -» 
defined  by  (2.2-8).  Throughout  the  remainder  it  is  assumed  that 
n  takes  on  the  integer  values  between  -N  and  N  Inclusive. 
Definition  (A-1)  implies  the  existence  of  a  parameterization 
from  C^N+I  onto  A. 

The  propagation  time  delay  due  to  the  mass  center  motion  of 
the  target  relative  to  the  radar  is  often  a  smooth  function  of 
time  and  so,  for  the  sake  of  argument,  define  T  by 

M 

T  -  list  -  T(t)|T(t)  -  I  t^t®,  in  r}  (A-2) 

'  .  m  m 

m-0 


where  R  is  the  field  of  real  numbers.  As  with  definition  (A-1), 
definition  (A-2)  implies  the  existence  of  a  parameterization 
from  rM'^^  onto  T.  Constraints  arising  from  external  force 
effects  could  be  included  if  desired.  The  additional  parameters 
might  be  estimated  jointly  with  other  parameters  or  their  values 
might  be  available  as  prior  knowledge. 

Define  z:t  -►  z(t)  by 


34 


'v 
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I-'*!.'' j 


vv 


Now  the  receiver  signal  s:t  s(t)  analogous  to  (2.2-7) 


becomes 

=  (t)  -  I 

n--N 

where 

(J>(t)  =  (-F  c„  -  F  cV2T  -  f„T(t)  -  b^T*(t)/2T) 
n  n  n  n  n  n 

+(f  +f  +bc/T+b  T(t)/T)(t  -  nA) 
n  n  n  n  n 

+  (-b  /2T  -  b  /2T)(t  -  nA)*. 
n  n 

For  the  specific  forms  (A-?)  and  (A-8)  of  s;t 
linear  subproblem  (3.2-3)  is  easy  to  solve.  There 
{ufi(T):t  ■*  Un(T)(t)}n  of  orthogonal  functions  which 
the  set  of  ideal  receiver  signals.  Each 
Un(T);t  Un(T)(t)  is  defined  by 

Un(T)(t)  ^  q^(t)e^’'“**’^*^^ 

and 

(()(t)  -  (-f„  -  b„T(t)/2T)T(t) 

n  n 

+(f  +f  +bc/T+b  T(t)/T)(t  -  nA) 
n  n  n  n  n 

+  (-b„/2T  -  b  /2T)(t  -  nA)*. 


(A-7) 


(A-8) 

s  ( t )  the 
s  a  set 
span 


(A-9) 


(A-1  0) 


The  orthogonality  follows  from  the  assumption  that  the  product 


qn(t)qm(t)  Is  Identically  zero  for  all  t  when  n  >•  m.  From 
(A-7)f  s;t  s(t)  can  also  be  defined  by 

N 

s(t)  -  I  Y^u^(T)(t)  (A-11) 

n--N 

where 


^  ,  2iTj(-f  c  -b  cV2T) 

Y  -  Ae  nn  nn 

n  n 


(A-1 2) 


From  (A-11),  (A-12)  and  the  definition  of  it  is  clear  that 
{un(T) In  spans  • 

A 

Then  it  follows  that  s(a^,  t),  the  solution  of  the  linear 
subproblem  (3*2-3)  is  defined  by 


**  N 

S(a  ,  T)(t)  •  I  Y  u  (T)(t)  (A-13) 

T  n  n 

n>»-N 


where 


Y 


n 


<r 


^2wJ  (-f„c^-b„cV2T) 
e  n  n  n  n  . 


(A-1 4) 


We  may  formally  pass  from  a  space  of  continuous  time 
functions  to  by  'sampling'  the  values  of  each  continuous 
function  at  times  tj^  for  k  -  1,  2,  ...  K.  Although  in  general 
some  caution  is  required,  in  this  trivial  case  sampling  will  not 
destroy  the  orthogonality  of  the  functions  Un(T).  The 
definition  of  inner  product  required  in  (A-14)  becomes 


<A-15) 


<r,  u„(,)>  -  I  r(t|,)u„(,)(t^) 

K-  1 

and,  of  course, 

iiu^(T)i|*  -  <u^(t),  u^(t)>. 

Therefore,  in  the  closed  form  solution  of  the  linear 
subproblem  is  given  by  (A-13)  and  (A-I^l)  using  the  definitions 
(A-15)  and  (A-16). 

As  discussed  in  Section  3,  sCa^,  t)  is  required  to  solve 
the  alternate  problem  (3.2-5)  or  the  final  problem  (3.2-10)  by 
numerical  optimization  over  T.  Solutions  of  either  of  these 
problems  are  shown  in  Section  3  to  be  solutions  of  the  principal 
problem  (3.2-1).  With  the  definition  of  inner  product  and  norm 
given  by  (A-15)  and  (A-16),  the  solution  of  the  principal 
problem  is  called  the  least  squares  solution  because  of  the 
particular  form  assumed  by  the  norm  of  the  error  r  -  s(a,  t). 

In  order  to  estimate  the  number  of  real  floating  point 
operations  per  unit  time  required  to  approximate  the  solution  of 
the  final  problem  (3.2-10)  define 

s  -  number  of  complex  receiver  samples  per  pulse,  and 
p  -  number  of  pulses. 

The  objective  is  to  maximize  ||s(a^  1)11  »  or  equivalently 


(A-16) 


Suppose  that  sine  and  cosine  evaluations  do  not  require 
floating  point  operations  and  that  s  >  10  (so  that  per-sample 
operations  dominate  per-pulse  operations).  Then  in  the 
computation  of  ils(aTf  t)!!*  requires  about  (16  +  2M)sp  floating 
point  operations,  more  or  less. 

The  choice  of  a  numerical  optimization  algorithm  to 
maximize  jis(oT,  T)jl*  over  T  is  beyond  the  scope  of  this 
report.  Just  for  purposes  of  estimating  the  number  of  floating 
point  operations  required  per  unit  time,  assume  that  the 
algorithm  is  similar  to  the  Algol  procedure  presented  by  Brent 
in  Ref,  [3].  This  algorithm  optimizes  by  successive  quadratic 
approximation.  Brent's  experience  suggests  that  approximately 
3(M  +  1)*  evaluations  of  tjs(a^,  T)i!®  are  required  to  compute  a 
quadratic  approximation.  Because  the  transmitted  signal 
x:t  -»  x(t)  and  the  propagation  delay  T;t  -*■  T(t)  are  chosen  to 
make  i|s(a^,  t  )  ||  *  a  well  behaved  function  of  imi  three 
successive  quadratic  approximations  should  adequately 
approximate  the  maximum  of  ((s(a^,  1)11*.  The  total  computation 
cost  becomes  about  9(16  ♦  2M)(M  +  1)*sp  floating  point 
operations  and  Ap  time  units  are  avilable  for  real  time 
computation.  Thus  the  required  rate  R  is  given  by 

R  .  9(16  ^  2M)(M  ^  1  )*sp  _  9Xl6_  +  _2M2iM_+_j_21§  (A-17) 

Ap  A 

floating  point  operations  per  unit  time. 


Suppose  a  quadratic  target  delay  was  to  be  estimated  In  a 
system  using  16  samples  per  pulse  and  .030  second  Interpulse 
periods.  Then 

R  =  .86(1 0®  )  (A-1 8) 

floating  point  operations  per  second.  Such  rates  are  easily 
achieved  in  modern  commerical  hardware. 

We  briefly  note  that  from  (A-17)  the  rate  Is  independent  of 
the  value  of  p,  the  number  of  pulses.  Thus  to  reduce  the 
variance  of  estimated  quantities  it  is  possible  to  increase  the 
value  of  p  (assuming  other  factors  remain  unchanged)  until  the 
computing  system  storage  is  fully  utilized.  As  a  practical 
matter,  a  large  enough  increase  in  the  value  of  p  finally 
requires  that  the  value  of  M  also  be  increased,  indirectly 
relating  the  computation  rate  R  to  the  number  of  pulses  p. 
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The  range  estimation  problem  is  generally  solved  by  assuming  a  low  order  target  mam  center 
motion  description  (such  a*  constant  velocity  or  constant  acceleration)  or  by  postulating  a  well  defined 
manuever.  Assumptions  are  often  made  that  require  the  receiver  signal  associated  with  a  well  tracked 
target  to  have  a  narrow  bandwidth.  These  assumption*  are  unreasonable  for  certain  range  estimation 
problems.  An  approach  general  enough  for  use  with  virtually  any  pulsed  narrowband  transmitter 
waveform  and  a  variety  of  finite  parameter  description*  of  time  varying  target  range  and  crom  section 
is  developed.  The  associated  best  approximation  problem  is  nonlinear  but  has  a  special  structure  which 
permit*  a  computable  solution  in  applications  of  interest  involving  thousands  of  unknowns.  An 
Appendix  provides  an  example  of  estimating  a  polynomial  propagation  delay  from  observation*  of  the 
radar  receiver  signal. 


